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SYSTEMS AND METHODS FOR 
AUTOMATED VESSEL NAVIGATION USING 
SEA STATE PREDICTION 

RELATED APPLICATIONS 5 

This application claims priority to U.S. Provisional. Appli- 
cation 61/355,064 filed Jun. 15, 2010 and U.S. Provisional. 
Application 61/474,839 filed Apr. 13, 2011, the disclosures of 
which are incorporated herein by reference. 1 

STATEMENT OF FEDERAL SUPPORT 

The invention described herein was made in the perfor- 
mance of work under a NASA contract, and is subject to the 15 
provisions of Public Law 96-517 (35 U.S.C. §202) in which 
the Contractor has elected to retain title. 

FIELD OF THE INVENTION 

20 

The present invention is generally related to sea state pre- 
diction and automated vessel navigation, and more specifi- 
cally to sea state prediction by detecting wave fronts and 
automated vessel navigation based upon main wave direction. 

25 

BACKGROUND 

Vessel navigation on fluid surfaces such as the sea can be 
more difficult than vehicle navigation on rigid surfaces such 
as on land. Waves on fluid surfaces apply significant force to 30 
vessels, in particular when such vessels are moving with high 
speeds in severe sea conditions. Severe sea conditions are sea 
conditions with significant wave activity. Severe sea condi- 
tions can be acutely fell in littoral operations, or operations 
close to shore, where the shallow water and underwater geog- 35 
raphy can create significant wave lengths and speeds. Vessels 
that can command high speeds or that are of a small mass are 
especially vulnerable to damage from severe sea conditions. 
This damage caused by kinetic wave energy includes crew 
injuries, capsizing, bow diving or other damage to the vessel. 40 
Furthermore, waves can slow a vessel down from reaching its 
target destination. Severe sea conditions are not limited to 
conditions at sea but can apply to conditions on any body of 
water including fresh or salt water as well as an ocean, lake or 
river. 45 

The difficulty of navigating a vessel in severe sea condi- 
tions is further compounded for autonomous vessel naviga- 
tion. Difficulty can arise where vessel navigation depends 
upon the limited resources of machine sensory equipment and 
processing to navigate the vessel. 50 

SUMMARY OF THE INVENTION 

Systems and methods in accordance with embodiments of 
the invention perform sea state prediction and/ or autonomous 55 
navigation. One embodiment of the invention includes a 
method of predicting a future sea state including generating a 
sequence of at least two 3D images of a sea surface using at 
least two image sensors, detecting peaks and troughs in the 
3D images using a processor, identifying at least one wave- 60 
front in each 3D image based upon the detected peaks and 
troughs using the processor, characterizing at least one propa- 
gating wave based upon the propagation of wavefronts 
detected in the sequence of 3D images using the processor, 
and predicting a future sea state using the at least one propa- 65 
gating wave characterizing the propagation of wavefronts in 
the sequence of 3D images using the processor. 


2 

In a further embodiment, generating a sequence of at least 
two 3D images of a sea surface uses two pairs of image 
sensors. 

In another embodiment, generating a sequence of at least 
two 3D images of a sea surface also includes using a radar 
sensor in combination with the at least two image sensors. 

In a still further embodiment, images sensors capture black 
and white images. 

In a still another embodiment, image sensors capture color 
images. 

In a yet further embodiment, detecting peaks and troughs 
includes using a random sampling process. 

In a yet another embodiment, detecting peaks and troughs 
includes using a least means squares process. 

In a further embodiment again, detecting peaks and troughs 
includes using a thresholding process. 

In another embodiment again, identifying at least one 
wavefront includes using a nearest neighbor process. 

In a further additional embodiment, characterizing at least 
one propagating wave includes determining the amplitude, 
frequency and velocity of at least one propagating wave. 

In another additional embodiment, characterizing at least 
one propagating wave includes determining the direction of at 
least one propagating wave. 

In a still yet further embodiment, characterizing at least one 
propagating wave includes determining the wave phase of at 
least one propagating wave. 

A still yet another embodiment further includes autono- 
mously navigating a vessel based upon a predicted future sea 
state. 

A still yet another embodiment includes a method of 
autonomous vessel navigation based upon a predicted sea 
state and target location, including determining at least one 
subtarget based upon target location and predicted sea state 
using a macronavigation system, communicating at least one 
subtarget to the micronavigation system, and controlling a 
vessel to navigate toward at least one subtarget using a 
micronavigation system. 

In a still further embodiment again, a predicted sea state 
includes a main wave direction. 

In still another embodiment again, a predicted sea state 
includes a wave phase information. 

In a still further additional embodiment, a subtarget is the 
target location. 

In still another additional embodiment, a micronavigation 
system includes a proportional integral derivative controller. 

In a yet further embodiment again, navigating toward at 
least one subtarget causes the vessel to tack relative to a main 
wave direction. 

In a yet another embodiment again, a subtarget causes the 
vessel to navigate at 60 degrees relative to the main wave 
direction. 

In a yet further additional embodiment, controlling the 
vessel includes controlling the throttle and the rudder of the 
vessel. 

In a yet another additional embodiment, a predicted sea 
state is predicted using at least one propagating wave charac- 
terizing propagation of wavefronts from detected peaks and 
troughs in a sequence of 3D images. 

A further additional embodiment again includes a system 
for predicting a future sea state including a sensor system 
configured to capture information concerning the shape of the 
sea surface, a sea state processor configured to communicate 
with a sensor system, wherein the sensor system and the sea 
state processor are configured so that captured information is 
used to generate a sequence of 3D images of a sea surface, 
wherein the sea state processor is configured to detect peaks 
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and troughs in the 3D images, identify at least one wavefront 
in each 3D image based upon the detected peaks and troughs, 
characterize at least one propagating wave based upon the 
propagation of wavefronts detected in the sequence of 3D 
images using the processor, and predict a future sea state 
using at least one propagating wave characterizing the propa- 
gation of wavefronts in the sequence of 3D images using the 
processor. 

In another additional embodiment again, a sensor system 
includes two pairs of image sensors. 

In another further embodiment again, a sensor system 
includes a radar sensor. 

In another further embodiment, a sensor system and a sea 
state processor are configured so that captured information is 
used to generate a sequence of black and white 3D images of 
a sea surface. 

In still another further embodiment, a sensor system and a 
sea state processor are configured so that captured informa- 
tion is used to generate a sequence of color 3D images of a sea 
surface. 

In yet another further embodiment, a sea state processor is 
configured to detect peaks and troughs using a random sam- 
pling process. 

In another further embodiment again, a sea state processor 
is configured to detect peaks and troughs using a least means 
squares process. 

In another further additional embodiment, a sea state pro- 
cessor is configured to detect peaks and troughs using a 
thresholding process. 

In still yet another further embodiment, a sea state proces- 
sor is configured to identify at least one wavefront using a 
nearest neighbor process. 

In another yet additional embodiment, a sea state processor 
is configured to characterize at least one propagating wave by 
the amplitude, frequency and velocity of the at least one 
propagating wave. 

In another yet further embodiment, a sea state processor is 
configured to characterize at least one propagating wave by 
the direction of the at least one propagating wave. 

In another yet additional embodiment again, a sea state 
processor is configured to characterize at least one propagat- 
ing wave by the wave phase of the at least one propagating 
wave. 

Another yet further embodiment again includes an autono- 
mous vessel navigation system that utilizes the predicted 
future sea state to determine vessel heading when navigating 
toward a target. 

A further embodiment includes an autonomous vessel 
navigation system, including a macronavigation system con- 
figured to receive a predicted sea state and a target as inputs 
and to generate a subtarget as an output, and a micronaviga- 
tion system configured to receive a subtarget as an input and 
to generate vessel control signals as outputs, wherein the 
macronavigation system is configured to determine at least 
one subtarget based upon the target location and the predicted 
sea state, and co mmu nicate at least one subtarget to the 
micronavigation system, and wherein the micronavigation 
system is configured to generate vessel control signals that 
head a vessel toward at least one subtarget. 

In a yet further additional embodiment, a predicted sea 
state includes a main wave direction. 

In a further additional again embodiment, a predicted sea 
state includes wave phase information. 

In another further embodiment again, a subtarget is a target 
location. 
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In yet another further embodiment again, a micronaviga- 
tion system includes a proportional integral derivative con- 
troller. 

In a further embodiment, a macronavigation system is con- 
5 figured to cause a vessel to tack relative to a main wave 
direction. 

In yet a further embodiment, a macronavigation system is 
configured to determine at least one subtarget that causes 
vessel navigation at 60 degrees relative to a main wave direc- 
10 tion 

In a yet further embodiment again, a micronavigation sys- 
tem is configured to generate vessel control signals config- 
ured to control the throttle and the rudder of a vessel. 

15 In another further embodiment yet again, a macronaviga- 
tion system is configured to receive a predicted sea state from 
a system for predicting a future sea state. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 

FIG. 1 illustrates a system diagram of a sea state prediction 
and autonomous vessel navigation system in accordance with 
an embodiment of the invention. 

FIG. 2 is a flow chart illustrating a process for autonomous 
25 vessel navigation involving the detection of wave fronts in 
accordance with an embodiment of the invention. 

FIG. 3 is a flow chart illustrating a process for detecting 
wave fronts from a 3D map of a current sea state in accor- 
dance with an embodiment of the invention. 

30 FIG. 4 is a flow chart illustrating a process for autonomous 
vessel navigation using a target, main wave direction and 
wave phase prediction in accordance with an embodiment of 
the invention. 

FIG. 5 illustrates a control framework for an autonomous 
vessel navigation system utilizing a macronavigation system 
and a micronavigation system in accordance with an embodi- 
ment of the invention. 

FIG. 6 illustrates a control framework for a macronaviga- 
40 tion system in accordance with an embodiment of the inven- 
tion. 

FIG. 7 illustrates a determination of a subtarget from an 
appropriate point of sail given a target position and main wave 
direction in accordance with an embodiment of the invention. 
45 FIG. 8A illustrates experimental results for bow-diving as 
a function of the maximal point of sail for head seas in 
accordance with an embodiment of the invention. 

FIG. 8B illustrates experimental results for bow diving as a 
function of the maximal point of sail for following seas in 
50 accordance with an embodiment of the invention. 

FIG. 9A illustrates experimental results for a stand-alone 
PID controller compared to the PID controller configured to 
tack using a macronavigation system in accordance with an 
embodiment of the invention with bow diving as a function of 
55 the wave height H. 

FIG. 9B illustrates experimental results for a stand-alone 
PID controller compared to the PID controller configured to 
tack using a macronavigation system in accordance with an 
embodiment of the invention with time of travel. T as a 
60 function of the target direction d. 

FIG. 10 illustrates the trajectories generated by an autono- 
mous navigation system that utilizes tacking to navigate to a 
target 1 00 meters away in 1 8 different directions in accor- 
dance with an embodiment of the invention. 

65 FIG. II illustrates the difference between normalized 
heave response between vessel navigation with an autono- 
mous navigation system in accordance with an embodiment 



US 8,989,948 B2 


5 

of the invention and one without the autonomous navigation 
system for a 13 meter high speed vessel operating at 35 knots 
over a range of sea states. 

DETAILED DESCRIPTION 

Turning now to the drawings, systems and methods for 
automated vessel navigation using predictions of sea state 
conditions are illustrated. In various embodiments, sensors 
capture 3D maps of the sea surface. From the 3D maps, a 
model for the sea state is found from which sea state predic- 
tions are made. Sea state predictions can be made by detecting 
the peaks and troughs of waves from a noisy signal. Using the 
sea state predictions, a vessel can be autonomously navigated 
to minimize the forces experienced by the vessel and its crew 
associated with severe sea conditions. In this way, autono- 
mous navigation systems in accordance with embodiments of 
the invention can improve the speed with which a vessel can 
reach a target in severe sea conditions, while reducing the 
likelihood of damage to the vessel and/or crew. In many 
embodiments, the autonomous navigation system utilizes a 
number of subtargets calculated based upon a main wave 
direction (derived from a predicted sea state) and a target 
location. The vessel speed, heading and load balancing state 
can be adjusted to reach the subtargets during the autonomous 
navigation. Thereby, utilizing only machine sensory input, a 
vessel can autonomously navigate severe sea conditions in a 
way that limits the forces and/or damage experienced by the 
craft and crew. 

In many embodiments, autonomous sea surface navigation 
utilizes 3D maps where features of the sea state are extracted. 
Sea state features include any potential hazards such as debris 
on the water or strong currents or waves on the sea surface. A 
sequence of 3D images of the sea surface can be analyzed to 
predict future sea states. Sea states can be determined by 
modeling the observed undulations in the sea surface as being 
caused by one or more propagating planar waves. In several 
embodiments, the sea state prediction involves locating peaks 
and troughs in a sequence of 3D images in order to the 
propagation of wavefronts. The wavefronts can then be used 
to estimate the amplitude, frequency and velocity of each 
observed propagating wave. In a number of embodiments, 
peaks and troughs of waves can be found through statistical 
methods that detennine high and low points within a 3D map 
that can then be grouped to identify wavefronts. Once the 
amplitude, frequency and velocity of the waves are deter- 
mined, predictions can be made concerning the sea state at a 
time in the future. In many embodiments, the sea state pre- 
diction is utilized to derive safe paths to a target that limit the 
forces experienced by the craft or crew. 

In several embodiments, autonomous navigation systems 
determine paths to a target utilizing navigation techniques 
including tacking by determining the vessel’s point of sail 
relative to wave direction (as opposed to wind direction). 
Tacking is a maneuver employed in sailing by which a vessel 
turns its bow through the wind so that the direction from 
which the wind blows changes from one side to the other. 
Similarly, for wave direction, tacking is a maneuver by which 
a vessel turns its bow through the wave so that the direction of 
the forward force of the wave changes from one side of the 
vessel to the other. Points of sail typically describe a sailing 
boat’s course in relation to the wind direction, such as by 
utilizing tacking to sail into the wind. Using the points of sail 
analogy with respect to wave direction, the term point of sail 
is used here to describe the direction in which a vessel navi- 
gates relative to wave direction. In particular embodiments, 
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an autonomous navigation system constantly updates the 
heading of the vessel in response to the dynamic nature of the 
sea surface. 

Systems and methods for performing sea state prediction 
5 and automated vessel navigation using sea state predictions in 
accordance with embodiments of the invention are discussed 
further below. 

System Architecture 

Autonomous navigation systems in accordance with many 
to embodiments of the invention include a system where sen- 
sors, processors and controllers function to predict a sea state 
and to provide navigation instructions to a vessel. FIG. 1 
illustrates a system diagram of a sea state prediction and 
autonomous vessel navigation system 100 in accordance with 
15 an embodiment of the invention. The system 100 includes a 
radar sensor 102 and camera sensors 104. These sensors are 
connected to a sea state processor 106, vessel navigation 
processor 108 and vessel navigation controller(s) 110 via a 
network 112. 

20 In the illustrated embodiment, the camera sensors (104) are 

configured as a stereo pair and can be utilized in combination 
with the radar sensor (102) to create a sequence of 3D images 
of the sea state. These 3D images of the sea state can be 
processed by a sea state processor to predict future sea states. 
25 In certain embodiments, the sea state processor can model the 
sea state for future predictions by detecting multiple wave- 
fronts over time to estimate the amplitude, frequency and 
velocity of the wavefronts. In various embodiments, wave- 
fronts are determined by detecting the peaks and troughs in a 
30 noisy signal through methods including (but not limited to) 
high and low point clusters on the 3D images of the sea state. 
The detection of wavefronts in accordance with embodiments 
of the invention is discussed below. 

In the illustrated embodiment, the sea state prediction and 
35 autonomous vessel navigation system 1 00 navigates the ves- 
sel based upon the sea state predictions. In certain embodi- 
ments, information related to a main wave direction or wave 
phase is used to determine a tack plan or subtarget location as 
part of a navigation plan to reach a predetermined target. 
40 Vessel speed, heading and load balancing in view of the target 
can then be updated by the sea state prediction and autono- 
mous vessel navigation system 100. 

In many embodiments, the system is implemented locally 
on a vessel or can utilize remote computing resources. The 
45 sensors can be any kind of sensor capable of producing 3D 
images of a sea surface. In addition, the sea state processor 
and vessel navigation processor can be implemented using 
the same physical computing system or on different proces- 
sors. Vessel navigation controllers canbe any controller that is 
50 used to control vessel navigation. In many embodiments, the 
sea state prediction and autonomous vessel navigation system 
is implemented using a Control. Architecture for Robotic 
Agent Command and Sensing (CARACaS) manufactured by 
Spatial. Integrated Systems, Inc. of Virginia Beach, Va. 

55 Processes related to a sea state prediction and autonomous 
vessel navigation in accordance with embodiments of the 
invention are discussed further below. 

Sea State Prediction and Autonomous Navigation 

As the sea surface changes, sea state predictions can be 
60 utilized to facilitate autonomous navigation to targets. FIG. 2 
is a flow chart illustrating a process 200 for performing sea 
state prediction for use in autonomous vessel navigation in 
accordance with an embodiment of the invention. The process 
200 begins by detecting (202) wave fronts in an initial 3D 
65 image. After detecting (202) initial wave fronts, the move- 
ment of the wave fronts can be tracked by detecting (204) 
wave fronts in subsequent 3D images. Based upon the loca- 
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tion of wave fronts in the sequence of 3D images, the ampli- 
tude, frequency and velocity of the wavefronts can be esti- 
mated ( 206 ). After the characteristics of the observed waves 
are estimated ( 206 ), sea state predictions ( 208 ) can be made 
by modeling the propagation of the observed waves at a point 
of time in the future. Based upon the sea state prediction 
( 208 ), the system can plan ( 210 ) a course toward a target 
destination. After the system begins to navigate ( 210 ) along 
the course to the target destination, a decision ( 212 ) is made as 
to whether the target has been reached. If the target is not yet 
reached, the system continues to collect information used to 
refine sea state predictions and to navigate to the target based 
upon the sea state predictions. If the target is already reached, 
then the process ends. 

In many embodiments, initial wave fronts are detected by 
determining peaks and troughs in a noisy signal thorough 
statistical analysis of high and low point clusters. The initial 
wave fronts can be observed by analyzing a single 3D map of 
a sea state or multiple 3D maps of a sea state captured from 
different perspectives and then fused or processed in a similar 
maimer that exploits the redundancy in the images. Similar 
analysis can be utilized to detect wavefronts in subsequent 3D 
map(s) of the sea surface. 

In several embodiments, sea state predictions can be made 
based upon the expected behavior of multiple wave fronts 
modeled as planar waves . Tracking the waves from one image 
or 3D map of the sea surface to the next can enable the 
determination of the amplitude, frequency and velocity of the 
waves. Once these parameters are known for each wave, 
future sea states can be predicted. 

In a multitude of embodiments, navigation toward a target 
can be accomplished by navigating toward a subtarget depen- 
dent upon the sea state and the target location. The subtarget 
allows for vessel navigation to adapt to changing sea states. 
Autonomous navigation systems that utilize information 
obtained from sea state predictions in accordance with 
embodiments of the invention are discussed further below. 
Prior to discussing autonomous navigation systems, however, 
processes related to wave front detection in accordance with 
embodiments of the invention are discussed. 

Wave Front Detection 

Wave fronts can be detected by processing information 
from a 3D map of the sea surface. FIG. 3 is a flow chart 
illustrating a process 300 for detecting wave fronts from a 3D 
map of the sea surface in accordance with an embodiment of 
the invention. The process 300 begins by obtaining ( 302 ) a 3D 
map of the sea surface. After obtaining ( 302 ) the 3D map, 
peaks and troughs on the 3D map are detected ( 304 ) within 
the noisy signal. After detecting ( 304 ) the peaks and troughs, 
the wavefronts are then detected ( 306 ). 

A machine vision system can generate a sequence of 
images that can be used to generate a 3D map of how sea state 
changes over time. The system can use one or more stereo 
camera systems and the sensor data from the stereo camera 
systems can be combined with additional information from 
other types of sensors including but not limited to radar sys- 
tems. Certain systems use two pairs of cameras to obtain 
stereo 3D images that are then fused. Several systems use 
black and white cameras, although color cameras or a com- 
bination of color and black and white can be used in other 
systems. In many embodiments, radar information is fused 
with information captured by stereo camera systems to obtain 
better low light performance and to increase the range of the 
3D map. In other embodiments, any of a variety of sensor 
systems that can generate 3D images can be utilized including 
but not limited to array cameras. 
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In a variety of embodiments, peaks and troughs can be 
detected in a noisy signal through signal processing. A sea 
state detection system can take a sequence of 3D images of 
the sea surface over a short period of time. A sequence of high 
5 and low point clusters can be detected across the 3D images 
using a number of different processes including but not lim- 
ited to the RANdom SAmple Consensus or RANSAC pro- 
cess, a least means square process, and/or thresholding. 

3D images of a sea surface generate a significant amount of 
to noise as the water is dynamic and reflections in the water can 
be difficult for systems to handle. A number of methods can 
also be used to filler noise from the captured 3D images. The 
RANSAC process is an iterative method to estimate param- 
eters of a model from a set of observed data, which contains 
15 outliers, or data that does not fit a model. RANSAC can be 
used to filler out noise through an assumption that given a set 
of inkers, there is a procedure which can estimate the param- 
eters of a model that optimally explains or fits the data. The 
least means square ELMS) process finds the coefficients for a 
20 specific function that produces the least mean square of the 
error signal, or the difference between the desired and the 
actual signal. Thresholding is a process whereby peaks and 
troughs are identified based upon a value being above or 
below a specified threshold. Although specific processes for 
25 detecting peaks and troughs are disclosed above, any of a 
variety of processes can be utilized in accordance with 
embodiments of the invention. 

In numerous embodiments, wavefronts can be detected by 
analyzing the peaks and troughs. Once the peaks and troughs 
30 are detected, then they can be grouped together to locate the 
wave fronts of planar waves on the water. The nearest neigh- 
bor algorithm can be used to identify wave fronts from clus- 
ters of peaks or clusters of troughs. The nearest neighbor 
algorithm classifies an object by a majority of its neighbors, 
35 with the object being assigned to the class most common 
amongst its nearest neighbors. In other embodiments, any of 
a variety of algorithms can be utilized to group peaks and 
troughs to identify wavefronts. 

Although specific processes are described above for 
40 detecting wavefronts within 3D images of a sea surface. Any 
of a variety of processes that are capable of detecting planar 
waves in sequences of captured 3D images can be utilized in 
accordance with embodiments of the invention. Once wave- 
fronts have been detected, a sea state prediction can be per- 
45 formed and a vessel can autonomously navigate relying upon 
the sea state prediction. Processes related to autonomous 
vessel navigation in accordance with embodiments of the 
invention are discussed further below. 

Autonomous Vessel Navigation 

50 Autonomous vessel navigation systems can utilize sea 
state predictions to improve system performance in any of a 
number of ways including (but not limited to) attempting to 
limit the forces experienced by a vessel and/or its crew in 
severe sea states. In many embodiments, the sea state may be 
55 sufficiently severe as to warrant navigating to avoid waves as 
opposed directly toward a target. FIG. 4 is a flow chart illus- 
trating a process 400 for autonomous vessel navigation using 
a target, and main wave direction in accordance with an 
embodiment of the invention. The process 400 begins by 
60 determining ( 402 ) the main wave direction from the predicted 
sea state. After determining ( 402 ) the main wave direction, a 
path to the target is developed ( 404 ). In several embodiments, 
planning the path to the target can utilize the predicted phase 
of the main wave obtained using a sea state prediction to time 
65 turns relative to the phase of the wave. After determining 
( 404 ) a path to the target, a subtarget is determined ( 406 ) and 
the vessel speed, heading and load balancing are updated 
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( 408 ) to steer the vessel toward the subtarget. Autonomous 
vessel navigation systems in accordance with embodiments 
of the invention are discussed further below. 

Autonomous Navigation Control Framework 

Autonomous vessel navigation can be facilitated using a 
control framework. FIG. 5 illustrates a control framework 
500 for autonomous vessel navigation utilizing a macronavi- 
gation system and a micronavigation system from target and 
sensory information in accordance with an embodiment of 
the invention. In the control framework, both the target 502 
and sensor 504 feeds into the macronavigation system 506 . 
The macronavigation system 506 feeds into the micronavi- 
gation system 508 , which can be a proportional-integral- 
derivative controller (PID controller). In the illustrated 
embodiment, the micronavigation system 508 feeds into both 
the throttle 510 and the rudder 512 of the vessel. The status of 
the throttle 510 and rudder 512 of the vessel effects a sea state 
prediction or real world conditions 514 . The sea state predic- 
tion or the real world conditions 514 then affects the target 
502 and the sensor 504 . 

In many embodiments, macronavigation processes deter- 
mine the way autonomous navigation occurs while micron- 
avigation processes determine how the autonomous naviga- 
tion strategy should be implemented. Both the target and the 
sensory data are used by the macronavigation system to plot 
the best navigable path to the target given the observed sea 
state (obtained using the sensor system). In certain embodi- 
ments, the macronavigation system masks the target position 
and calculates subtargets that are provided to the micronavi- 
gation system so that the vessel does not head directly toward 
the actual target. In this way, the macronavigation system can 
implement tacks and/or other maneuvers that can limit the 
forces experienced by the vessel and its crew. The micronavi- 
gation controls the throttle and rudder of the vessel to head the 
vessel toward the target or subtarget provided to the rnicron- 
avigation system by the macronavigation system. After the 
throttle and rudder states are updated, new sea state predic- 
tions can be used by the autonomous navigation system to 
update the path the vessel takes to the target. 

In certain embodiments, for reliable target reaching, a PID 
control approach is used by the micronavigation system. A 
PID controller is a generic control loop feedback mechanism 
that calculates an “error” value as the difference between a 
measured process variable and a desired set point. The con- 
troller attempts to minimize the error by adjusting the process 
control input. In many embodiments, the PID controller 
drives the throttle strength and position based on the current 
target (or subtarget) position provided to the micronavigation 
system relative to the vessel. The throttle strength is propor- 
tional to the absolute target distance, and the rudder command 
is proportional to the target direction. In calculations for 
particular embodiments, t(t)=(x,y) is the target position and 
p(t) is the current vessel position in world coordinates at time 
t. Then, the control deviation is c(t)=t(t)-p(t). The control 
deviation is translated into command signals according to the 
following equation for the throttle strength: 

W=PMfi\\+U\foHOdt]\+Di\e(t)-e(t-l)\\ 

The control deviation is translated into command signals 
according to the following equation for the rudder position, 
where e v is the control deviation that points sideways to star- 
board along the y-axis of the vessel according to the coordi- 
nate system as seen by the vessel: 

r(t)^P^Jf)+IJ 0 T e y (t')dt'+D r \e y {t)-e y (t-l)\ 

Targets behind the vessel require a turn of the vessel. This 
can easily be achieved by multiplying throttle and rudder 
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co mm ands with sgn(e v (t)) and with sgn(c T )(t)), respectively. 
In a number of embodiments, the following gain constants 
can be used: P,=0.03; I r =D r =P,.=0.02, 1,.=0 and D,.=0.01. The 
throttle and rudder commands can be restricted to a reason- 
5 able range by clipping their values to [-0.25, 0.7] and [-0.4, 
0.4], In other embodiments, any of a variety of micronaviga- 
tion systems can be utilized including PID control systems 
that incorporate alternative parameters and/or constraints. 

As discussed above, the subtargets utilized by micronavi- 
to gation systems are generated by macronavigation systems in 
accordance with embodiments of the invention. FIG. 6 illus- 
trates a control framework 600 for macronavigation in accor- 
dance with an embodiment of the invention. In the control 
framework 600 , a target 502 is used to determine ( 610 ) the 
15 direction from the vessel to the target. The target is also 
provided to a navigation planner 612 . Sensor data 504 is used 
to determine ( 614 ) a main wave direction. In many embodi- 
ments, the main wave direction can be determined using a sea 
state prediction process similar to any of the sea state predic- 
20 tion processes outlined above. The difference between the 
target direction 610 and the main wave direction 614 deter- 
mines ( 616 ) the point of sail of the vessel relative to the main 
wave. The point of sail is fed into the navigation planner 612 , 
which generates a subtarget that is provided to the micron- 
25 avigation system 508 . As is discussed further below, the 
macronavigation system illustrated in FIG. 6 can be utilized 
to incorporate tack planning into a macronavigation process 
in accordance with embodiments of the invention. 

Tack Planning 

30 In several embodiments, tacking behavior constrains ves- 
sel motion to minimize the effects of severe sea conditions, 
such as bow diving. Bow diving is when a vessel’s bow is 
submerged due to either the motion of the boat or the sea 
surface. In many embodiments, tack planning is used to deter- 
35 mine subtargets in autonomous vessel navigation to limit the 
forces that are experienced by the vessel and/or crew as it 
navigates toward a target. 

Referring back to the macronaviagtion system illustrated 
in FIG. 6. knowledge about the point of sail (POS) necessary 
40 to reach a target is an important part of implementing a tack 
planner. In certain embodiments, the POS is calculated 
depending on the target direction (TD) and the main wave 
direction (MWD) by POS=TD-MWD. Thus, a prerequisite 
for the planner is the estimation of the MWD. While deriva- 
45 tion of the target direction from the target position is straight- 
forward, the main wave direction is extracted from sensory 
information. 

Macronavigation systems in accordance with many 
embodiments of the invention tack at certain angles to mini- 
50 mize bow diving. FIG. 7 illustrates a determination of a sub- 
target from an appropriate point of sail given a target position 
and main wave direction in accordance with an embodiment 
of the invention. In the illustrated embodiment, when the 
point of sail necessary to reach the target is too steep with 
55 respect to the main wave direction, the planner determines 
that a subtarget that is the projection of the original target onto 
the appropriate point of sail. 

FIG. 8A illustrates experimental results for bow diving as 
a function of the maximal point of sail for head seas in 
60 accordance with an embodiment of the invention. Likewise, 
FIG. 8B illustrates experimental results for bow diving as a 
function of the maximal point of sail for following seas in 
accordance with an embodiment of the invention. As illus- 
trated in both FIGS. 8A and 8B, bow diving is significantly 
65 reduced around a tack of 60 degrees in both head and follow- 
ing seas. Thereby in certain embodiments, tack planning can 
take advantage of tacking at around 60 degrees. 
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Generally, points of sail in parallel or antiparallel to the 
MWD result in considerable bow diving. The navigation 
planner creates subtargets for tacks according to a safe point 
of sail p opt , when the point of sail p necessary to reach a target 
falls into one of the following ranges: 5 

-pfcg if - s P s 0 

if o <p< p h ™? 

iso -pSHT if < P <m 

iso +pt£T n m<p<m + p f ^ ,w 

A subtarget is created that is the projection of the original 15 
target onto the adopted point of sail p .. In doing so, the 
navigation planner transfers the direct path to the target into a 
tacked path that circumvents extreme points of sail with the 
risk of bow diving. In various embodiments, the concept of 
subtarget generation is illustrated in FIG. 7. Certain embodi- 20 
ments yield ideal values for p max head and p ma / oUow where 
PmaJ’ ead= Pma/° 11 ° w= 6Q degrees. Therefore, certain embodi- 
ments use a 60 degree margin around head and following 
seas. In other embodiments, a greater or lesser margin can be 
used as appropriate to specific applications. 25 

FIG. 9A illustrates experimental results for a stand-alone 
PID controller compared to a TPID-Controller that is con- 
trolled by a macronavigation system that implements tacking 
the manner outlined above with bow diving as a function of 
the wave height H in accordance with an embodiment of the 30 
invention. FIG. 9B illustrates experimental results fora stand- 
alone PID controller compared to a TPID-Controller that is 
controlled by a macronavigation system that implements 
tacking the manner outlined above with time of travel T as a 
function of the target direction d in accordance with an 35 
embodiment of the invention. Experimental results for FIGS. 

9 A and 9B were generalized for wave heights H from 0 meters 
to 3 meters. 

FIG. 9A illustrates how the addition of the tack planner in 
certain embodiments significantly improves the performance 40 
with respect to bow diving. However, for small wave heights 
certain embodiments favor not utilizing tacking as embodi- 
ments that tack dive more often with the bow than a stand- 
alone microcontroller. This is due to the increased travel 
distance, which consequently results in an increased number 45 
of wave crests to pass. The extra time of travel caused by the 
increased travel distance due to the tacks is revealed in FIG. 

9B. But the increased time of travel is rather moderate and 
worth investing for the security gained by the tack planner. In 
numerous embodiments, tacking and the appropriate tack 50 
angles p op l' ead and p op { ollow are selected depending on the 
current sea state. In particular embodiments in the case of a 
calm sea state, tacking is not necessary and p opt ead as well as 
Po P t° w can b e set to zer °. However, bow diving is signifi- 
cantly reduced for severe sea conditions. Moreover, FIG. 9B 55 
indicates how bow diving depends on the relation of the 
vessel’s length and the wave length. Thereby in certain 
embodiments only for a specific region around a wave height 
of 1 .6 m, the vessel dives considerably with the bow into the 
water. For these wave heights, shallow water can yield wave 60 
lengths similar to the vessel’s length. 

FIG. 10 illustrates the trajectories generated by an autono- 
mous navigation system that utilizes tacking in the mamier 
outlined above to navigate to a target 100 meters away in 18 
different directions in accordance with an embodiment of the 65 
invention. Grey areas (700) indicate the occurrence of bow 
diving. In the illustrated embodiment, trajectories generated 
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by the autonomous navigation system generate tacks that 
avoid heading and following seas. The PID controller suc- 
ceeds also in the planning condition to steer the vessel to the 
desired targets. In certain embodiments, bow diving does not 
occur as frequently as for the stand-alone PID controller. In a 
number of embodiments, tack planning generates a tack- 
trigger mechanism that triggers turning depending on the 
wave phase. 

In numerous embodiments, autonomous navigation sys- 
tems integrate adaptive planning and control that can be simu- 
lated, for example with hardware in the loop (HWIL) devel- 
oped by the Jet Propulsion Laboratory headquartered in 
Pasadena, Calif. HWIL simulation is a technique used in the 
development and testing of complex real time embedded 
systems utilizing mathematical representations for each 
dynamic system. FIG. 11 illustrates the difference between 
normalized heave response between vessel navigation with 
an autonomous navigation system in accordance with an 
embodiment of the invention and one without the autono- 
mous navigation system for a 13 meter high speed vessel 
operating at 35 knots over a range of sea states as simulated in 
a HWIL. In the illustrated embodiment, heave responses are 
generally minimized with adaptive path planning and control 
relative to systems without adaptive path planning and con- 
trol. 

While the above description contains many specific 
embodiments of the invention, these should not be construed 
as limitations on the scope of the invention, but rather as an 
example of one embodiment thereof. 

What is claimed is: 

1 . A method of autonomous vessel navigation based upon 
a predicted sea state and target location, comprising: 

predicting a future sea state using at least one propagating 
wave characterizing propagation of wavefronts from 
peaks and troughs detected in a sequence of at least two 
3D images of a sea surface; 

determining at least one subtarget based upon a target 
location and the predicted sea state using a macronavi- 
gation system; 

communicating the at least one subtarget determined based 
upon the target location and the predicted sea state to a 
micronavigation system; 

controlling a vessel to navigate toward the at least one 
subtarget using the micronavigation system; 

receiving an updated prediction of the future sea state using 
the macronavigation system; and 

updating the at least one subtarget based upon the target 
location and the updated predicted sea state using the 
macronavigation system. 

2. The method of claim 1, wherein the predicted sea state 
comprises a main wave direction. 

3. The method of claim 2, further comprising determining 
a point of sail, wherein the point of sail is determined using 
the difference between the target direction and the main wave 
direction. 

4. The method of claim 1, wherein the predicted sea state 
comprises a wave phase information. 

5 . The method of claim 1 , wherein the subtarget is the target 
location. 

6 . The method of claim 1, wherein the micronavigation 
system comprises a proportional integral derivative control- 
ler. 

7 . The method of claim 1 , wherein navigating toward the at 
least one subtarget causes the vessel to tack relative to a main 
wave direction. 
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8. The method of claim 1, wherein the subtarget causes the 
vessel to navigate at 60 degrees relative to a main wave 
direction. 

9 . The method of claim 1 , wherein controlling the vessel 
comprises controlling a throttle and a rudder of the vessel. 

10 . The method of claim 1 , wherein updating the at least 
one subtarget comprises generating a new subtarget. 

11 . The method of claim 10 , wherein the at least one 
subtarget is determined based upon a point of sail and the 
predicted sea state. 

12 . An autonomous vessel navigation system, comprising: 

a macronavigation system configured to: 

receive a predicted sea state and a target as inputs and to 
generate a subtarget as an output, wherein the pre- 
dicted sea state is predicted using at least one propa- 
gating wave characterizing propagation of wavefronts 
from peaks and troughs detected in a sequence of at 
least two 3D images of a sea surface; 
determine at least one subtarget based upon the target 
location and the predicted sea state; and 
communicate the at least one subtarget determined 
based upon the target location and the predicted sea 
state to a micronavigation system; and 
wherein the micronavigation system is configured to: 
generate vessel control signals that head a vessel toward 
the at least one subtarget; 
receive an updated predicted sea state; and 
update the at least one subtarget based upon the target 
location and the updated predicted sea state. 
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13 . The system of claim 12 , wherein the predicted sea state 
comprises a main wave direction. 

14 . The system of claim 13 , wherein the macronavigation 
system is further configured to determine a point of sail, 

5 wherein the point of sail is determined using a difference 
between the target direction and the main wave direction. 

15 . The system of claim 12 , wherein the predicted sea state 
comprises wave phase information. 

16 . The system of claim 12 , wherein the subtarget is the 
to target location. 

17 . The system of claim 12 , wherein the micronavigation 
system comprises a proportional integral derivative control- 
ler. 

18 . The system of claim 12 , wherein the macronavigation 
15 system is configured to cause the vessel to tack relative to a 

main wave direction. 

19 . The system of claim 12 , wherein the macronavigation 
system is configured to determine at least one subtarget that 
causes vessel navigation at 60 degrees relative to a main wave 

20 direction. 

20 . The system of claim 12 , wherein the micronavigation 
system is configured to generate vessel control signals con- 
figured to control a throttle and a rudder of a vessel. 

21 . The system of claim 12 , wherein the macronavigation 
25 system is configured to receive the predicted sea state from a 

system for predicting a future sea state. 

22 . The system of claim 12 , wherein updating the at least 
one subtarget comprises generating a new subtarget. 



